Papers with dialogue generation task

6 papers
Conversations Are Not Flat: Modeling the Dynamic Information Flow across Dialogue Utterances (2021.acl-long)

Copied to clipboard

Challenge: Recent intelligent open-domain chatbots have made substantial progress thanks to the rapid development of large-scale pre-training approaches.
Approach: They propose a dynamic flow mechanism to model the context flow and a model to capture the information dynamics across dialogue utterances.
Outcome: The proposed model outperforms the DialoGPT on the dialogue generation task.
Combining Curriculum Learning and Knowledge Distillation for Dialogue Generation (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have shown that curriculum learning facilitates dialogue generation tasks while knowledge distillation can yield significant performance boosts for student models.
Approach: They propose a combination of curriculum learning and knowledge distillation for dialogue generation models . they cluster training cases according to their complexity and employ an adversarial training strategy .
Outcome: The proposed model improves compared with baselines.
Dirichlet Latent Variable Hierarchical Recurrent Encoder-Decoder in Dialogue Generation (D19-1)

Copied to clipboard

Challenge: Existing work assumes the Gaussian priors of the latent variable, which are incapable of representing complex latent variables effectively.
Approach: They propose to use the Dirichlet distribution with flexible structures to characterize latent variables in place of the Gaussian priors.
Outcome: The proposed model outperforms existing models on the dialogue generation task.
Adaptive Bridge between Training and Inference for Dialogue Generation (2021.emnlp-main)

Copied to clipboard

Challenge: Experimental results show that our model can achieve a significant improvement in terms of metric-based evaluation and human evaluation compared with the state-of-the-art exposure bias approaches.
Approach: They propose a novel adaptive switching mechanism which automatically transits between ground-truth learning and generated learning regarding the word-level matching score.
Outcome: The proposed model improves on Chinese and English reddit datasets compared with state-of-the-art models on the word-level matching score.
A Simple and Efficient Multi-Task Learning Approach for Conditioned Dialogue Generation (2021.naacl-main)

Copied to clipboard

Challenge: Existing studies have focused on conditioned dialogue generation, but there is a scarcity of labeled responses.
Approach: They propose a multi-task learning approach to leverage labeled dialogue and text data to generate conditioned dialogues.
Outcome: The proposed approach outperforms the state-of-the-art models by leveraging the labeled texts and obtains larger improvement compared to the previous methods to leverage text data.
Dynamic Stochastic Decoding Strategy for Open-Domain Dialogue Generation (2024.findings-acl)

Copied to clipboard

Challenge: Stochastic sampling strategies are not widely used in open-domain dialogue systems.
Approach: They propose a dynamic decoding strategy which can adjust the decoding space w.r.t. different contexts.
Outcome: The proposed decoding strategy can improve the performance of pre-trained models when coupled with four well-used stochastic decoding algorithms.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations